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ABSTRACT 

This report attempts to discover how students think 
about and use mathematics in open-ended questions. Part I, 
"Open-ended Questions in Mathematics, " describes the rationale for 
adding open-ended questions to the grade 12 mathematics test of the 
California Assessment Program (CAP), part II describes the findings 
from students' responses to five selected open-ended problems from 
the 1987 test. Strengths and weaknesses in the students' responses 
are examined, including students' misconceptions. In part III the CAP 
advisory committee's reasons for developing the scoring procedure 
used for the five open-ended questions are discussed. Five scoring 
procedures for five problems are presented. Part IV includes 20 
student responses that have been scored and two responses that are in 
the ten problems given in 1987 and 1988. A set of nine open-ended 
problems were presented. (YP) 
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Preface 



What is tested is what gets taught. Tests must measure what is 
most important. 1 



The California Assessment Program (CAP) is committed to aligning its assessment 
practices with the concepts presented in the Mathematics Framework for California Public 
Schools: Kindergarten Through Grade Twelve* the Mathematics Model Curriculum Guide: 
Kindergarten Through Grade Eight? and such publications as the Curriculum and Evalu- 
ation Standards published by the National Council of Teachers of Mathematics. 4 Edu- 
cators as well as the public believe that the influence of assessment on the curriculum 
greatly affects the classroom teaching and learning processes. 

Open-ended questions in mathematics (those requiring a written response, as opposed 
to multiple choice) have the potential to drive the curriculum in positive directions 
sought by leaders in education The written responses required by open-ended 
mathematics questions stimulate students to think about mathematical problems and 
enable the students to communicate their mathematical thinking and solutions to 
others. When teachers can see students' thought processes sketched out in some detail, 
they can then target instruction appropriately to develop students' thinking further. 

This report is the first large-scale attempt to discover how students think about and use 
mathematics. Readers will find that questions posed to students were written to 
stimulate their higher-level thinking processes (e.g., to make assumptions, see connec- 
tions among strands of mathematics, explain to an audience, use data organization and 
graphing, and understand mathematical procedures). The examples illustrated in this 
report should serve as a powerful medium to learn about students' levels of accom- 
plishment as well as methods for positively influencing classroom instruction in 
mathematics. 



' Everybody Counts: A Report to the Nation on the Future of Mathematics Education. Washington, D.C: National Academy Press, 
1989/ p. 69* 

2 Mathematics Framework far California Public Schools: Kindergarten Through Grade Twelve, Sacramento: California State 

Department of Education, 1985. 
y Mathematics Model Curriculum Guide: Kindergarten Through Grade Eight, Sacramento: California State Department of 

Education, 1987. 

* Curriculum and Evaluation Standards for School Mathematics. Reston,Va: National Coundi of Teachers of Mathematics, 1989. 



Many educators have contributed to the development of questions and to the prepa- 
ration of this report. Although the Mathematics Assessment Advisory Committee 
provided much of the innovative thinking, many other educators serving on the ad hoc 
committees contributed to the improvement of the content of this report. The names 
of the Mathematics Assessment Advisory Committee members and members who 
served on the ad hoc rubrics development and scoring committee are given in the 
Acknowledgments. The Department wishes to thank these professionals, who gave 
their talents generously to improve assessment practices. We also thank the school 
districts that willingly provided release time for many of these educators. 

We suggest that readers try a few of the questions before reading students' responses. 
This approach will give an idea of the thinking involved in answering the questions. 
Since this is the first report of its kind, we encourage readers to provide comments 
about assessment through the use of open-ended questions or about any other aspect 
of this report. Questions should be directed to Tej Pandey or Kathie Scott of the 
California Assessment Program (916-322-2200). 

JAMES R. SMITH FRANC1E ALEXANDER 

Deputy Superintendent Associate Superintendent; and Director, 

Curriculum and Instructional Leadership Curriculum:, Instruction, and Assessment Division 
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Parti 



Open-ended Questions in Mathematics 



Open-ended questions were included in the grade twelve mathemat- 
ics test of the California Assessment Program (CAP) for the first time 
in 1987-88. This report describes the rationale for adding these 
questions. More important what was learned from students' re- 
sponses to the open-ended questions is described and related to ideas 
for improving classroom instruction. 

The multiple-choice portion of the grade twelve mathematics test was 
changed to align it with the concepts presented in the Mathematics 
Framework for California Public Schools: Kindergarten Through Grade 
Twelve and in the Model Curriculum Standards: Grades Nine Through 
Twelve. 1 Seventy percent of the questions on the revised test involved 
problem solving and applications, and the remaining items tested 
understanding of mathematical concepts and principles. 

The inclusion of open-ended questions is part of C AFs long-standing 
emphasis on aligning assessment with principles from the California 
curriculum frameworks. Open-ended questions were intended to 
improve the grade twelve tesf s alignment with the concepts pre- 
sented in the 1985 Framework in the following ways: 

• Open-ended questions provide students an opportunity to 
think for themselves and to express their mathematical ideas 
that are consistent with their mathematical development. 

• Open-ended questions call for students to construct their own 
responses instead of choosing a single answer. 

• Open-ended questions allow students to demonstrate the depth 
of their understanding of a problem, almost an impossibility 
with multiple-choice items. 



CAP emphasizes 
aligning assessment 
with principles from 
the curriculum 
frameworks. 



Students construct 
their own responses 
instead of choosing 
a single answer. 



1 Model Curriculum Standards: Crades Nine Through Twelve. Sacramento: California State Department 
of Education, 1985, 



ERIC 



. . . open-ended questions 

• Open-ended questions encourage students to solve problems 
in many ways, in turn reminding teachers to use a variety of 
methods to "get across" mathematical concepts. 

• Open-ended questions model an important ing/edient of good 
classroom instruction: openness to diverse responses to class- 
room questioning and discussion. Similarly, open-ended 
questions in assessment help educators move away from a 
curriculum of bits and pieces of information to a curriculum 
where orudent* apply a set of mathematical tools as they are ap- 
propmte to situations. 

Since the use of open-ended questions to assess students' knowledge 
of mathematics is new in California, this portion of *he 1987-88 Survey 
of Academic Skills, Grade 12 served as a pilot to inform educators about 
the introduction of new kinds of tasks in future CAP assessments. A 
subcommittee of the Mathematics Assessment Advisory Committee 
developed the open-ended questions and prepared this report on 
students' responses. 

By presenting open-ended questions that required written responses, 
the committee sought to gain evidence for the importance of writing 
in the mathematics curriculum. Good mathematics teachers have 
learned that writing is both a way of thinking and of communicating. 
By writing freely about problems, students often can discover solu- 
tions. By reporting their methods in writing, students can tell others 
how to solve problems. By reading what students have written, 
teachers can gain more informed insights into students' knowledge 
and possible misconceptions, compared with what teachers learn 
from seeing only students' mathematical computations or answers. 

We invite you as classroom teachers to read this report and to consider 
how you might use open-ended questions in your instruction. We 
suggest that you go through the booklet at least twice. The first time, 
| you may want to browse through the students' answers to get a sense 
I of the range of responses. The second time, try going back to read the 
I committee's expectations for responses to each problem and the ways 
! in which students went astray. See whether you agree with our 
| recommendations for mathematics instruction directed toward ad- 
[ dressing students' misconceptions, 
i 

j We also urge you to try these open-ended questions and many othprs 
I with your own students. We believe that you will be convinced,, as was 
] the committee, that students clearly need more experience with situ- 
i ation-orienteri ooen-ended problems. 



By uniting freely 
about problems, 
students can 
discover solutions. 
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. . . test description 



Description of the Mathematics Portion of the Grade Twelve Test j 

i 

i 

The mathematics section of the 1987-S8 version of the twelfth grade 
CAP test consisted of 360 multiple-choice and five open-ended ques- 
tions. Each student was asked to answer 1 1 multiple-choice questions j 
(one without calculators and ten with calculators allowed) and one j 
open-ended question. Although there was no strict time limit for stu- j 
dents to answer questions, approximately 15 minutes were allowed 
for the multiple-choice items and 12 minutes for the single open-ended 
question. j 

f 
i 

i 

Developing Open-ended Questions 

In developing open-ended questions, the committee faced decisions 
regarding the structure of the items. A tightly structured question is 
easily scored but yields little interesting information about mathe- 
matical understanding. A broadly structured question allows stu- 
dents to respond creatively, demonstrate the full extent of their mathe- 
matical understanding, and display the elegance and originality of 
their thought processes. The committee struggled with this dichot- 
omy and decided to try out a variety of questions, from tightly 
structured to somewhai broadly structured. Of the fivo questions 
described in this report, questions b and E have tight structures, i 
whereas questions A, C, and D have relatively broad structures. j 

! 
I 

Scoring Students' Responses 

i 

! 

Open-ended questions can be scored in several ways. Two frequently ; 
used methods of scoring students' writing are analytic and holistic. In 
analytic scoring, the evaluator considers whether specific points have j 
been addressed in the student's response. A student is scored accord- j 
ing to the points that have been satisfactorily covered. In holistic 
scoring, judgment is based on the response as a whole rather than on 
specific features of the response. Thus students' essays or responses 
are assembled in several stacks from low to high, according to the 
levels of the responses, Holistic scoring focuses on the n.erits of the i 
response as a whole, rather than on how well the writing conforms to j 
predetermined analytic schemes. Scoring holistically leaves the evalu- , Scoring holistic illy 
ator free, as we hope a teacher would be, to respond to the student's allows for a re- 
entire thinking process rather than concentrate on the number of spouse to the entire 
points to be marked off according to a scheme. thinking process. 



. . . scoring students' responses 



Implicitly, with holistic scoring more responsibility is placed on the 
student to determine the important elements of the question, provid- 
ing opportunities for students to respond creatively. With analytic 
scoring the assumption is that questions have been well structured for 
the student and elicit well-defined patterns of student behavior. 

For the convenience of classroom teachers who develop their own 
open-ended questions and wish to score students' responses to them, 
we have provided a general scoring rubric. Please refer to page 53 in 
Part III of the report for a rubric or rule that outlines criteria for scoring 
open-ended mathematics questions, in general. 



Open-ended 
questions can test 
students' under- 
standing and help 
teachers improve 
math instruction. 



Reporting Results 

The committee reviewed a random sample of 2,500 responses, ap- 
proximately 500 responses to each of the five questions, out of a total 
of 240,000 responses from twelfth grade students statewide. Since 
funding was provided to score only a sample of responses, there were 
not enough responses from which to compute school-by-school re- 
sults. Therefore, this report reflects only the statewide performance on 
the open-ended questions. A "Summary of Students' Performance on 
the Open-ended Questions" appears on page 5 of the report. 

This booklet was assembled to report the results of the 1987-88 pilot 
test of open-ended questions in such a way that teachers will perceive 
their utility both for testing students' understanding and for improv- 
ing mathematics instruction. Thus students' responses to each of the 
five open-ended questions, problems A, B, C, D, and E (students' 
"papers"), are described in the following format: 



• A statement of the problem is given. 



• "General Expectations" presents the committee's expectations 
for students' responses to the problem; for example: 

- What does the problem require, and how do we expect the 
students to work out a solution? 

- What elements of the problem relate to the Mathematics 
Framework? 

• "Strengths and Weaknesses in Student Responses" examines: 

- What approaches led students to solve the problem? 



. . . reporting results 

- What difficulties prevented students from reaching a good | 
solution? 

This section presents an examination of the students' miscon- 
ceptions and a description of teaching implications which 
suggest instructional strategies to overcome students' 
difficulties. 

• "Summary of Results and Instructional Implications" provides 
the percentages of students who answered correctly or inco 
rectly and contains a summary of the implications for teaching 
learned from detailed examination of students' misconceptions 
and correct responses to the open-ended questions. 

The scoring rubrics for the five problems, together with a generalized 
rubric, compose Part III of the report. The scheme for scoring re- 
sponses to each problem consists of a paragraph statement of the 
requirements of an adequate response, followed by the criteria for 
scoring students' responses from zero (blank, "don't know") to six. 
For "inadequate" responses 1 or 2 points are given, 3 or 4 points are 
awarded to "satisfactory" responses, and 5 or 6 points to responses 
that show "demonstrated competence." Students' papers represent- 
ing the upper two scoring categories (3 or 4 and 5 or 6) are attached to 
the scoring rubric for each problem. Part IV contains 20 examples of 
students' work and nine additional open-ended problems. 

Future Plans 

The committee recommended that open-ended questions become a 
regular part of the mathematics portion of the Survey of Academic Skills: 
Gra^e 12, starting with the 1988-89 administration of the test. As the 
other grade level tests are revised, similar kinds of questions will likely 
be included at those grade levels as well. 

Summary of Students' Performance on the Open-ended Questions 

Of the approximately 500 papers reviewed for each problem, the 
following are the percentages of students whose answers showed 
"demonstrated competence/' were "satisfactory/' or were "inade- 
quate." Percentages of students giving no response also appear. 
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. . . summary of students' performance 



Demonstrated No 

competence Satisfactory Inadequate response 

Problem (in percent) (in percent) (in percent) (in jxreent) 

A 15 24 59 2 

B 14 21 58 7 

C 20 12 65 3 

D 15 27 52 6 

E 9 41 32 18 



Students' 
performance would 
improve with more 
writing and oral 
work. 



The committee members surmised that the inadequate responses of a 
large number of students occurred primarily because students are not 
accustomed to writing about mathematics. It is likely that students' 
performance on open-ended questions would vastly improve if stu- 
dents were given opportunities to describe their thought processes 
orally or in writing while solving problems. Problems that involve 
reasoning/ recognizing patterns or relationships/ analyzing situations 
using knowledge of mathematics/ aitd examining operational rela- 
tionships would be particularly valuable. Although the committee 
made recommendations regarding the implications for teaching re- 
lated to students' misconceptions, committer members emphasized 
that classroom teachers are in the best position to assess what needs to 
be done to help their students improve. 



Part II 



Discussion of Results 



Part II contains a discussion of the findings from the students' re- 
sponses to problems A, B, C, D, and E. The committee's general 
expectations are described. Strengths and weaknesses in students' 
responses are examined; included are sections on students' miscon- 
ceptions and teaching implications. Finally, the results of the students' 
responses and the instructional implications are summarized. 



Problem A 

Imagine you are talking to a student in your class on the telephone and want the 
student to draw some figures. The other student cannot see the figures. Write a set 
of directions so that the other student can draw the figures exactly as shown below. 



General Expectations 

Ability to communicate mathematical ideas with clarity is an impor- 
tant component of mathematical power as emphasized in the California 
Mathematics Framework. Good communication, both verbal and writ- 
ten, indicates understanding. Understanding of a problem and ability 
to think are prerequisites to successful problem solving. 




Problem A assessed the skills of communicating about geometric 
shapes. It requires students to use effective terminology to describe 



Problem A requires 
effective use of 
terminology. 



. problem A students' responses 



the necessary features, in correct steps, to reproduce the given geo- 
metric shapes. Responses revealed how well students formulated and 
communicated mathematical ideas. No single solution or method was 
correct. An effective solution would result in the precise reproduction 
of the figures. The use of the word exact in the problem implied that 
the student's written directions would preserve the scale and orienta- 
tion of the figures. It was also hoped that the instructions would be 
concise, mathematically elegant, and easy to follow. 

Strengths and Weaknesses in Students' Responses 

Students' strong responses generally followed one of three approaches: 
use of geometric terminology, coordinate geometry, or an algorithm. 
Examples 1, 2, 3, and 4 illustrate students' actual responses using one 
of these approaches successfully: 



Example 1. 




CD 

THE" fitute i3 -A G\tur TR,*«ci.e id,r* 
rue °\o m A nice cm the iw. 
U**c> s<i>e 

HUP TttC Hoti-zourAL. i£-£ /(5 S~ 

® CdMf4€t,T THer TWo Lees wry THC 
HV fortius t. f tO<»KM is J H u*<ts 



Example 2. 




C-(%1), P<*,Cp £=C L h-V 
F-0,'V <*<X%C>) Ct™***? 
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. . . problem A students' responses 



Example 3. 
/ — 




VnrV^. * Label po»v*fl. 

cAiOs.^t>vv»V y,v>* bat 4? 



Example 4. 

r — 



t©,v*. -V-jr-aT r + <* + V hcv 
y ver-Kccr Jinn. 4kc 



9 

ERJ.C 



problem A students' responses 



For most students, 
limited use of 
concepts marred the 
explanation. 



Example 1 shows that the student effectively used the knowledge of 
geometric terminology (right triangle, vertical/horizontal leg, and 
hypotenuse). In Example 2 the student used knowledge of coordinate 
geometry to provide directions for reproducing the figure. In ex- 
amples 3 and 4, the students took a aot-to-dot, or an algorithmic 
approach, to describe the figure. In Example 4, however, the student's 
wording is somewhat cumbersome and excessive. Group discussions 
and editing of writing in mathematics should help students to achieve 
more concise and elegant expression of ideas. 

The most serious difficulty for students was inadequate use of con- 
cepts to help communicate the instructions. For a vast majority of 
students, limited use of concepts got in the way of clear explanation. 

Some other obstacles included misuse of algebraic terms; tangled, 
cumbersome descriptions; and failure to note details such as scale, 
length of lines, or orientation of the figure. Examples 5, 6, and 7 show 
some of these misconceptions and related implications for classroom 
instruction. 



Example 5. 




Qcc*o ok f«(f*\ff| line 



L 



\7 «v\J^v 
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. . . problem 



A 



Misconception: 

Students attempted to use inappropriate mnthematical terms. 
Teaching Implications: 

Students need experiences explaining and defining ideas using mathe- 
matical terminology. 



Example 6. 



k*5 WCjO r -w^a^ Of) 

Aar fo 

1 4 u4<i 



Misconception: 

Students applied inappropriate algebraic formulas. 
Teaching Implications: 

In *heir eagerness to solve a problem, students often develop solutions 
before they know what it is they are solving for. The teacher's role is 
to guide students to read the problem, assess the situation, and figure 
out what is required. 
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. . . problem A summary of results 



Giving and 
following directions 
lead to insights. 



Few students are 
able to use mathe- 
matical terminology 
in writing 
explanations. 



Example 7. 

r 




tf..Me Mat. iCi*t£f#Li&Aifi 
&**u/ */ie top &t\e. 



Misconception: 

Students failed to consider scale, length of lines, use of graph paper, or 
orientation of the figure on the page. 

Teaching Implications: 

Activities in which students give and follow each other's directions 
will give students insights into achieving accuracy, completeness, and 
clarity of assumptions. 



Summary of Results and Instructional Implications 

Of the approximately 500 papers scored, fewer than 15 percent showed 
a solid response. Overall, the reviewers felt that most students at the 
twelfth grade level were not proficient at this sort of communication. 
The reviewers, most of whom were classroom teachers, commented 
that very few students seem to have had enough experience to be 
able to write explanations, give directions, or use mathematical 
terminology in writing explanations. 

Th^ committee members suggested that classroom activities include 
opportunities for students to write instructions to others for complet- 
ing mathematical tasks. Students can share this writing with each 
other and discuss ways in which they can communicate effectively. 
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. . • problem B general expectations 



Problem 8 



Look at these plane figures, some of which are not drawn to scale. Investigate what 
might be wrong (if anything) with the given information. Briefly write your findings 
and justify your ideas on the basis of geometric principles- 





Fig. I 



Fig. II 



Fig. IK 



General Expectations 

The National Council of Teachers of Mathematics 7 Curriculum and 
Evaluation Standards for School Mathematics (1989) states that: 

Making conjectures, gathering evidence, and building an argument 
to support such notions are fundamental to doing mathematics. In 
fact, a demonstration of good reasoning should be rewarded even 
more than students' ability to find correct answers. 1 

In Problem B, students were asked to examine three geometric figures In Problem B, stu- 
to assess their understanding of the relationships between parts of dents were asked to 
geometric figures and the measures of those parts. For each of the three make and justify 
figures, students were required to make some assertions and justify some assertions. 
whether or not the figures were valid, on the basis of geometric 
principles. 

To give a correct response in Figure I, the student would have to 
indicate that the figure was invalid for any of these reasons: 

• No triangle could be formed having the given angle measures 
since the sum of the measures of the angles of a triangle is 180 
degrees. 

• No right triangle could be formed having the given angle 
measures since the sum of the measures of the acute angles of 
a right triangle is 90 degrees. 



1 Curriculum and Evaluation Standards for School Mathematics. Reston, Va.: National Council of 
Teachers of Mathematics, 1969, p. 6. 
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. . . problem B general expectations 



Students giving 
strong responses 
used precise lan- 
guage and logic. 



• Some related theorem or property made the information given 
false. 

Any one or all of the above responses were acceptable, with no one 
assertion being preferred. 

A correct response regarding Figure II required students to recognize 
that it was possible for a quadrilateral having sides with the given 
measures to exist. Students should realize that the figure was a 
trapezoid, even though it was not drawn to scale. They could use the 
square angle ABC or the coordinate grid to emphasize that AB and CD 
were parallel. 

In Figure in it was expected that students would recognize that either 
the measure of the radius (and hence the diameter) or the measure of 
the chord CD was incorrect. 

Strengths and Weaknesses in Students' Responses 

A feature of strong responses was the students' ability to use precise 
language to identify which figures were valid or invalid, citing geo- 
metric principles (examples 8, 9, and 10). The students provided 
logical and concise justifications. An extremely small number of 
students questioned whether or not point O was indeed the center of 
the given circle, and that observation was also valid. 



o 
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. . . problem B students' responses 



Example 8. 



Lob* at tte»e plane figures, some of which are not drawn to scale, investigate what 
&e wrong (If anything) with the given frrformatfoa Briefly write your finding* and Justify 
- -your ideas on the teals of geometric principles. 
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. . . problem B students' responses 



Example 9. 
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Example 10. 
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. . . problem B students' responses 



A typical weakness in students' responses was the inappropriate use 
of geometric principles or imprecise use of language. Students wrote 
such phrases as, A triangle is 180° not 170°/' In Figure HI they said 
that chord CD was a "ray/' a "tangent/' or a "diameter." Other 
difficulties are illustrated by excerpts from students' papers (see 
examples 11 through 17). 

Some common misconceptions were identified by the committee 
members, who then made the suggestions appearing in "Teaching 
Implications" to assist in classroom instruction. 

Example 21. 




a 



i-5 3o 



Misconception: 

Students often resoi led to applying inappropriate formulas to gener- 
ate a sequence of steps, whether correct or not. For example, students 
erroneously used the measures of angles as lengths of sides and 
applied the Pythagorean theorem. 

Teaching implications 

Students might be asked to justify their reasoning orally or in writing. 
Discussion problems should help students rely more on understand- 
ing the effective use of mathematics rather than mechanically apply- 
ing memorized formulas and procedures. Students generally lack a 
concrete basis for the geometric relations they learn. 



Students typically 
misuse geometric 
principles and use 
language 
imprecisely. 



Discussion 
problems help 
students rely more 
on understanding 
mathematics. 
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. . . problem B students' responses 



Geometric figures 
need to be taught 
through the use of a 
variety of concrete 
methods. 



Ability to judge the 
reasonableness of a 
solution is very 
important. 



Example 12. 





Misconception: 

Students thought that the sum of the interior angles of a triangle is 
something other than 180 degrees. 

Teaching Implications: 

Students' knowledge of triangles and other geometric figures needs to 
be taught through the use of a variety of concrete methods; for 
example, scissors and paper folding (cut off the angles and lay them on 
a straight line). 



Example 13. 



r 



A 




12 
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C 
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Misconception: 

Students used a trigonometric or other unduly advanced approach 
incorrectly to arrive at, or bluff, a solution. 

Teaching Implications: 

Students need to approach any problem with a multitude of strategies. 
Ability to judge the reasonableness of a solution is very important. 
More experience with a variety of methods is needed. 
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. . . problem 



B students' responses 



Example 14. 



■A 







* 


J 






i 



Misconception; 

Students bring in the "magic" number 90 when referring tD angles, but 
they used it this time for a perimeter. 

Teaching Implications: 

Students need to understand the differences between area, perimeter, 
and angle measurement, using investigations with manipulatives and 
holding discussions in cooperative learning groups. 




Misconception: 

This student derived a correct relationship through the use of geomet- 
rical knowledge; but having made false assumptions based on the 
drawing, he failed to draw the correct conclusion. 

Teaching Implications: 

Students must learn never to go by what something looks like. In- 
stead, they should read the directions and stick to the point of the 
problem. Students must stay focused on their goal and practice 
summarising the results of their calculations. Emphasizing the goal 
of each problem should assist these students in their solutions. 



S .3 need to 
unto,. ~*and the 
differences between 
area, perimeter, and 
angle measurement. 



Students must learn 
never to rely on a 
geometric figure's 
appearance. 
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. . . problem B students' responses 



Students should not 
use formulas in 
isolation. 





Misconception: 

Students thought that inserting available numbers into the formula for 
the area of a circle would generate the correct result. 

Teaching Implications: 

Awareness of what makes sense in a given problem must be em- 
phasized. Students should not be taught to use formulas in isolation. 



Example 17. 

r 



v. 





5^ .S t * 
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Misconception: 

Students bluffed, giving the appearance of trying out something 
sensible. 

Students need to Teaching Implications: 
understand rather Students often resort to senseless manipulation of data in order to try 
than guess at to get an answer. They need more experience communicating their 
answers, understanding rather than guessing at answers. 
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. . . problem B summary of results 



Summary of Results and Instructional Implications 

Of the approximately 500 papers scored by the committee, fewer than 
14 percent provided a response to Problem B that was more than 
adequate. For the most part, the justifications written in Problem B 
were slightly better than the "directions" written in Problem A; 
however, the quality was still only marginally acceptable overall. Al- 
though almost all students responded to one or more of these geomet- 
ric problems, the directions to justify were often ignored, or students' 
justifications minimally supported their assertions. 

The committee suggests that students be given more learning time 
with geometric relationships that can be measured and those that must 
be supported by theorems. The ability to communicate these relation- 
ships effectively is crucial to many professions. 

Students need opportunities to start at a concrete level and develop 
formulas themselves. Beyond that, they need to work on situations 
where many foimulas might be used, and they have to choose the one 
that is helpful. 



Many students gave 
minimal justifica- 
tion, if any, for their 
assertions. 



Problem C 

James knows that half of the students from his school are accepted at the public 
university nearby. Also, half are accepted at the local private college. James thinks 
that this adds up to 100 percent, so he will surely be accepted at one or the other 
institution. Explain why James may be wrong. If possible, use a diagram in your 
explanation. 



General Expectations 

An important aspect of mathematical power is the need to use logic 
and diagrams to make sense of a situation and tc communicate this 
reasoning. Diagrams are an effective analytical and communications 
tool. Problem C assesses the ability to detect erroneous reasoning and Problem C assesses 
requires a clear and mathematically correct explanation of the faulty the ability to detect 
reasoning. Specifically, the problem demands a recognition that and explain faulty 
acceptances from the different institutions are not mutually exclusive, reasoning. 
The students' responses should focus on the faulty reasoning involv- 
ing James's assumption of nonoverlapping sets. A variety of dia- 
grams or explanations could be used to help clarify the situation; no 
particular one was preferred. 
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. . . problem C students' responses 



Types of figures 
included Venn 
diagrams, pictures, 
comic strips, and 
pie graphs or charts. 



Strengths and Weaknesses in Students' Responses 

Of the students who succeeded in understanding and solving this 
problem, all were able to make a statement to the effect that some 
students may be accepted at both schools. 

This type of response was judged to be adequate in showing a grasp 
of the problem, but good responses included more complete explana- 
tions with examples and/or counterexamples and diagrams that 
clarified the reasoning. In f act, the variety of diagramming techniques 
was very exciting and included Venn diagrams, picture diagrams, 
keyed lists, comic strips, and pie graphs or charts. The diagrams used 
by those who were successful in solving this problem indicate that at 
least some students have had opportunities to create and analyze such 
models in their mathematics instruction. Examples 18 through 22 
illustrate good responses from students. 

Example 18. 







tXx. o^£*js. w-o^3l -^oA 




22 



. . . p r oblem C students' responses 



Example 19. 






Example 20. 

r 
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. . . problem C students' responses 



Example 21. 

r 
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Example 22. 



J 
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. . . problem C students' responses 



Students whose responses were inadequate digressed from the prob- 
lem, focusing on extraneous factors such as grades or graduation 
requirements. Others simply were unable to make sense of the 
problem and gave inappropriate answers or made misleading as- 
sumptions. The committee members identified some of the common 
misconceptions and made the suggestions appearing in 'Teaching 
Implications'' to assist in classroom instruction. 



Example 23. 

r 
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Example 24. 
/ 
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Misconception: 

Students questioned the hypotheses of the problem, made inappropri- 
ate assumptions, or did not correct James's reasoning. 

Teaching Implications: 

Students should be asked to distinguish among the given conditions 
of a situation, hidden assumptions, and unjustified assumptions. 
Students should articulate their reasoning in evaluating their own and 
their peers' reasoning. In addition to having students do formal 
proofs, using theorems, teachers should provide frequent group dis- 
cussion, writing, and drawing of diagrams. 



Students must 
distinguish between 
given conditions 
and unjustified 
assumptions. 
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. . problem C students' responses 



Students often 
resorted to 
meaningless symbol 
manipulation. 

Developing 
strategies should be 
emphasized. 



Example 25. 

> 

/ 




|'Z 



Misconception: 

Students often resorted to meaningless manipulation of symbols 
when confronted with a new problem situation. This student unsuc- 
cessfully attempted to produce an equation to represent the situation. 

Teaching Implications: 

The emphasis in the classroom should be on discussing and develop- 
ing appropriate strategies rather than on simply finding an answer. 

Example 26. 

/ 
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. . . problem C students' responses 



Example 27. 



0* 
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Misconception: 

Students were unable to provide an appropriate diagram to enhance 
their explanations. 

Teaching implications: 

Students need more opportunities to read, interpret, and create charts, 
tables, diagrams, and graphs. They should be able to abstract mathe- 
matical information from a situation and develop a model that 
represents the information. 



Students should be 
able to abstract 
information from a 
situation and 
develop a model. 



Example 28. 

r — 
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. . . problem C summary of results 



Students should be 
taught to use such 
tools as Venn 
diagrams. 



Students need to 
distinguish between 
important and 
extraneous 
information. 



Misconception: 

Students used an invalid assumption that the number of students was 
odd in attempting to prove that James's inference was incorrect. 

Teaching Implications: 

Students should be taught the use of tools such as Venn diagrams in 
order to identify false inferences in situations involving logic. 



Summary of Results and Instructional Implications 

Of the approximately 500 papers scored, only 20 percent of the 
responses showed that students were able to explain, with or without 
the help of diagrams, that an overlap can exist between the groups 
admitted to the college and the university. Approximately 25 percent 
of the students in the sample digressed from the point of the problem. 
Another 40 percent were unable to interpret the situation sensibly and 
gave inappropriate answers. 

In summary, the sample of responses to this problem showed a great 
need for an increase in experiences for all secondary students with 
diagrams and graphs, nonroutine problems, and recognition and 
interpretation of faulty reasoning. 

Although students and teachers should become accustomed to accept- 
ing and encouraging a variety of responses, we recommend that 
teachers help students focus on what the problem asks for. Students 
should identify important information and avoid using added consid- 
erations that are not relevant to solving the problem. 
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. . . problem D general expectations 



Problem D 

Consider the following problems. 

A. Maria has a job after school. Last week she worked 2 hours and earned $1 030. 
How much did she earn per hour? 

B. This week Maria worked 2 hours and earned $1030 per hour. How much did 
she earn this week? 

C. Maria worked two jobs. She earned $5.25 on the first and $1 030 on the second. 
How much did she eam altogether? 

1 . Which two problems are s nost similar and why? 

2. Which two problems are most dissimilar and why? 



General Expectations 

One important problem-solving strategy is to relate a given problem 
to a simpler or similar problem that can be solved or that has already 
been solved. To use this technique effectively, one must be able to 
identify those parts of the problems that are similar and to justify why 
the given information, relationships, or outcomes are indeed similar 
and which parts are dissimilar. 

In Problem D it was expected that students would choose some 
criterion or strategy that had mathematical significance and look for 
patterns of similarities or differences against that criterion or strategy. 
In fact, the question was written so that any pair of the three state- 
ments could be treated as most similar or dissimilar depending on the 
criteria chosen. 

Strengths and Weaknesses in Students' Responses 

Students whose responses were strong identified the mathematical 
criteria and other criteria on which they based their judgments and 
showed how their choices reflected these criteria. In addition, they 
indicated why the nonselected problem in each case failed to meet the 
criteria. However, none of the students took the problem beyond what 
specifically was asked for in order to describe how different criteria 
would produce different answers. 

The declining strength evident in responses of students between 
examples 2y and 32 parallels the variation in their ability to think 
mathematically and express themselves in comparisons and contrasts 
involving complex mathematical criteria. 



Students needed to 
choose a significant 
criterion as a basis 
for comparison. 



Many students have 
difficulty in making 
mathematical 
comparisons. 



29 



. . , problem D students' responses 



In this example the 
student described 
both similarities 
and differences to 
justify the pairs 
selected. 



Example 29. 

r 
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Example 29 is a particularly strong response. A clear thinker and 
writer, the student compared and contrasted problems on several 
mathematically relevant features: hourly wage as a rate; multiplica- 
tion and division as inverse operations, in contrast to addition; and 
overall total contrasted with rate. In describing both similarities and 
differences among problems, the student explained why the third 
problem in each case was not selected. 
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. . . problem D students' responses 



Example 30. 
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The student in Example 30 used a less important mathematical crite- 
rion than that given for Example 29 ("worked two hours") as the initial 
criterion for similarity between problems A and B. Yet, this student 
also strongly implied hourly wage rate as the major criterion for 
similarity. The student used two criteria for dissimilarity between 
problems A and C: two hours versus two jobs and division versus 
addition. However, the student did not acknowledge that the same 
rationale could be applied to dissimilarities between problems B and 
C. In neither case, similarity or dissimilarity of the problems, did the 
student mention reasons for excluding the nonselected problem. 



Example 32. 

r 



7 



In this example the 
student applied the 
chosen criteria 
inconsistently. 
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. . . problem D students' responses 



The explanation in 
this example is too 
brief and awkward 
to convey the 
concept of rate. 



Students need prac- 
tice in justifying 
their classification 
criteria. 



Inadequate 
responses focused 
on characteristics 
not relevant to the 
problem's context. 



The student in Example 31 recognized the major criterion for similarity 
between problems A and B, the concept of hourly wage rate. But the 
student's explanation is too brief and awkward to convey clearly the 
concept of rate or to ensure that the student himself understands it well 
enough to use it. 



Example 32. 



1. Whteft two probtems ar» most slmHar and why? 
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Finally, the student in Example 32 mentioned two minor points of 
similarity (''one job, same number of hours" for each problem) be- 
tween problems A and B, but he did not refer to rate or hourly wage as 
the major criterion for similarity. The student's oversimplified crite- 
rion of "different jobs, different wages" for the dissimilarity between 
A and C did not provide justification for the nonselection of B. 

Teaching Implications: 

Examples 29 through 32 illustrate the range of students' abilities re- 
garding this kind of problem. The results show that students need 
more opportunities to classify problems by multiple criteria. They 
need practice in justifying their choice of criteria for classification, 
demonstrating that the criteria are appropriate to the comparison or 
contrast. In particular, students need more work looking for mathe- 
matical concepts as a basis for classification rather than identifying only 
isolated numbers that are similar or different. 

Inadequate responses to Problem D focused on such characteristics as 
the numbers in the problem, or Maria's name appearing first in the 
sentence, without regard to the context of the situation being de- 
scribed. Those students who gave inadequate responses were not 
classifying similarity and differences among problems A, B, and C as 
complex situations. Instead, they were discussing only one or two 
surface similarities or differences in the numbers or mathematical 
terms stated in the pioblems. In some cases, they inferred information 
that was not given. 
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. . . problem D students' respo?ises 



Example 33. 
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Misconception: 

In classifying the similarities or dissimilarities among problems, stu- 
dents focused only on the criterion of what operation is used to find the 
solution. The student in Example 33 classified problems A and B as 
similar because of the inverse operations of multiplication and divi- 
sion taught concurrently in school. Students who classify problems on 
vague and simplistic criteria are likely to make false inferences about 
what problems require. 

Teaching Implications: 

Classification of problems only by what operations are used seems to 
reflect textbook organization of problem sets. (All problems in a set are 
solved using the same operations — only the numbers are changed.) 
This arrangement seems to lead to student questions such as, "Do we 
add or multiply to solve these problems?'' Focusing on one technique 
per problem set apparently produces the desire to use those operations 
in all problems in a set, regardless of the information that is pertinent 
in the problem. 

Example 34. 

r 



1 . Which two problems are most similar and why? . / 

2. Which two problem* are most dissimilar and why? / 



Using vague or 
simplistic criteria 
often leads to false 
inferences. 
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. . . problem D students' responses 



Students need more 
opportunities to 
identify and use 

given information. 



Example 35. 

^ 1 . Which two proWems are most similar and why? ft<4_G 



r 



Example 36. 

r 



Misconception: 

In examples 34, 35, and 36, students failed to recognize some of the re- 
lationships involved in each problem. This failure usually involved 
misinterpretation of the information requested. 

Teaching Implications: 

Students jump to conclusions based on the use of similar numbers in 
the opening sentences of the problems. Students need increased 
opportunities to identify the information given in the problem, its 
purpose, and its use in solving the problem. 



Example 37. 
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Example 38. 



34 



. . . problem 



D summary of results 



Misconception: 

In examples 37 and 38, students focused on a single number as a basis 
for declaring problems similar or dissimilar. 

Teaching implications: 

Making a variety of comparisons in problem situations is a useful 
technique for resolving those situations. Identifying multiple criteria 
for claiming similarity or dissimilarity can be helpful in developing an 
understanding of problems. 



Summary of Results and Instructional Implications 

Of the approximately 500 papers scored for problem D, fewer than 20 
percent of the responses were more than adequate. Students who 
wrote good responses compared problems in a variety of ways, using 
mathematical rather than incidental criteria. 

The responses as a whole indicated to the committee that many 
students are aware of some of the characteristics by wnich problems 
can be classified. Furthermore, some students can develop effective 
arguments. In general, students looked for some kind of criteria for 
establishing similarity and difference, although the criteria chosen 
may have been surface features rather than mathematical features cf 
the problem. A few of the better responses included an explanation of 
why the criteria chosen were appropriate for classifying these types of 
problems. 

A majority of students simply classified the problems by the basic 
opera lion to be used in solving the problem, without giving any 
additional explanation. Many students chose to compare these prob- 
1p*t s on the basis of either surface characteristics or irrelevant assump- 
tions, indicating a lack of experience with situations requiring them to 
analyze characteristics that different problems have in common. 

Approximately 27 percent of the students chose to describe the differ- 
ences because of the ways in which the problems were stated. Another 
15 percent of the students attempted to justify their choices with 
reasons that were based on superficial features; for example, compar- 
ing numbers, wording, or more general aspects of the situation. 
Students who focused on superficial or irrelevant characteristics had 
probably not had enough experience in classifying problems accord- 
ing to mathematical concepts. 



A majority of 
students simply 
classified problems 
by the arithmetic 
operations used to 
solve them. 



Superficial 
responses indicate a 
lack of experience in 
classification. 
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. . . problem E general expectations 



The committee recommends that teacher* giv? students more oppor- 
tunities to classify problems by multiple criteria in order to encourage 
students to look for mathematical differences or similarities rather than 
incidental differences; that is, differences that are not significant 
within the context of a mathematical situation. 



Students had to 
draw a set of tele- 
scoping squares and 
observe the pattern 
formed by the 
sequence of areas. 



Problem E 

Tht ^uare shown below has sides of length . units. Connect the midpoints of the 
sides of the square, in order, to form an interior square. Repeat the same process to 
make squares within squares. 



(a) Draw the first five interior s quares. 

(b) Write the sequence of numbers that 
represent the areas of the first five 
interior s quares. 

(c) What rule can be used to find the 
areas of the nth interior square? 



General Expectations 

In Problem E, students had to follow directions to draw a figure 
showing the telescoping of five interior squares. Then they had to 
calculate the areas of the interior squares, organize the information so 
that any pattern present could be observed, and conjecture about a 
general rule that could govern the situation. Algebra II texxbooks 
frequently include problems similar to this one that challenge stu- 
dents' creativity. 

Strengths and Weaknesses in Students' Responses 

The students who were able to translate correctly from the verbal 
description to a geometric figure made drawings that were neat, 
accurate, and complete, showing the telescoping of the five interior 
squares. Students who drew the figure correctly and also calculated 
the areas of the five interior squares generally appeared to use one of 
three approaches: 

• They used the Pythagorean theorem, found the length of a side, 
and then found the area. 

• They counted squares and partial squares on the grid behind 
the figure. 
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. . . problem 



E students' responses 



• They used a "transformations solution" by folding the corners 
of the larger squares inward to become the size of the next inner 
square. This procedure was not demonstrated, of course, but 
some students appeared to have visualized this process and 
used it in their solution. 

Students who conjectured about a general rule for the area oi the nth 
square used either an algebraic expression for the nth term of a 
sequence or stated a recursion rule. The algebraic formula for using n 
to find the area of the nth square was given in a variety of forms: 

4 1 
A„ = 22-n A n = ^, i4„ = ^,etc. 

The recursion formula was sometimes stated in words ('To find the 
area of the nth square, divide the area of the previous square by 2") or 
as a formula: 

Ai=2 




Examples 39 and 40 illustrate strong responses from students who 
completed all three steps of the problem: drawing the five telescoped 
interior squares, computing the sequence of areas, and stating a 
general rule. 

Example 39. 

\ 



ky Draw the first' five Interior squares." 




• i . 

_. e) What rule can be used to find the area of the n* Interior square? 

™.iri."T^ oka. by <9. 
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. . . problem E students' responses 



The majority of 
students were 
unable to complete 
step (a) of the 
problem . 



Example 40. 
/ 
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Misconception: 

The majority of students were unable to complete successfully step (a) 
of the problem, "draw the first five interior squares." One-fifth left the 
paper entirely blank. Many others either misunderstood the terms 
used in the question such as midpoint, square, interior, connective, and 
in order; or they could not assemble them into a coherent whole so as 
to translate a set of verbal instructions into an appropriate geometric 
figure. Example 41 shows three students' attempts: 




rrrnr: 
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. . . problem 



E students' responses 



Misconception: 

Many students ignored instructions to connect midpoints and simply 
drew the squares anywhere in the interior of the original square. The 
most common error was to connect opposite rather than consecutive 
midpoints. Example 42 portrays the drawings of a number of these 
students: 
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Teaching Implications: 

Although students have been given opportunities to translate from 
verbal situations to equations and arithmetic algorithms, they have 
not had enough experience in proceeding from verbal instructions to 
geometric figures. They need practice in using geometrical terms and 
then putting them together in a coherent whole. 
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Misconception: 

Students took into account only part of the specifications for the figure. 
Teaching Implications: 

Reading in mathematics is a skill that should be emphasized. Students 
should list data, select relevant parts, and ensure that all restrictions 
are applied. 



Students have not 
had enough 
experience in pro- 
ceeding from verbal 
instructions to 
geometric figures. 
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. . . problem E students' responses 



Students who successfully drew the first five interior squares fre- 
quently had difficulty with step (b) of the problem, "Write the 
sequence of numbers that represent the areas of the first five interior 
squares." 

Many students began computing the sequence of areas by assuming 
the area of the first interior square to be other than two square units. 
Many were apparently distracted by the grid behind the figure and 
gave the area of the first interior square to be either 64 or 32. Some 
students assigned larger dimensions to smaller squares. Example 44 
shows erroneous sequences given by eight different students. 

Example 44. 



Student Student Student Student 



One 




Three 


Fpur 


236 


1 


1 


2 


1.44 


2 


1 


1 1/2 


.64 


3 


1/4 


1 


.16 


4 


1/4 


1/2 


0 


5 


1/2 


0 



Student Student Student Student 





Six 


Seven 


Eight 


3 


2 


5 


n 


16 


4 


4 


n + 1 


26 


8 


3 


n + 2 


64 


11 


2 


n + 3 






1 


n +5 



Students need to 
check to see whether 
answers are 
reasonable. 



Misconception: 

Many students were confused about relati /e sizes, with dimensions 
either increasing or remaining the same as the sizes of the squares 
receded in the interior. Many of the students who completed steps (a) 
and (b) of the problem nevertheless were unable to complete step (c), 
generalizing to a rule that could be used to find the area of the tith 
interior, square. 

Teaching Implications: 

Students need to be involved in solving realistic problems wi th reason- 
able answers. 



Example 45. 
f 



Xtfo y- & -X" */k -y :S M 



40 



. . . problem 



E students' responses 



Rarely did the students make a chart, a problem-solving strategy that 
is taught as early as the primary grades; this approach seemed to have 
been abandoned by these twelfth graders. Those students who did 
make a chart were generally successful in generalizing to a rule. In 
Example 45 the student whose response is on the left used a chart to 
proceed from the number of the square, n, to the area of the nth square. 
However, the student whose work is on the right was unsuccessful; 
but he probably would have been able to find the pattern had he 
numbered the areas that he computed for the interior squares. 

Example 46. 



! i I - i • ( i i t i 



TO^s ^ ■•" :::x±i::."r-i:; H 



Example 47. 



-ft) MMIMtoi 



e) Whit ndtom to und to find ttw eras cf pm n* JflUdK •quart? 



fvi£t Mid/w/Lt ti oli£r wiirkrfymb. 



Students who made 
a chart were 
generally successful. 



Misconception: 

Students failed to observe patterns in the relationship between the 
number of the square and the area of the square. 

Teaching Implications: 

Relationships between the elements of a function should be taught on 
all grade levels and in all levels of classes. 
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. . . problem E students' responses 



Knowing students' 
thinking processes 
can help teachers to 
guide students 
toward forming 
generalizations. 



Example 48. 



'* SH 
O ■ 



ii L3 * > If) 



Misconception: 

Some students set up a sequence correctly, but they generalized to an 
inappropriate rule. 

Teaching Implications: 

In carefully examining students' work, teachers can ascertain the 
variety of ways in which students attempt to solve problems. Knowl- 
edge of students' thinking processes enables teachers to guide stu- 
dents to make generalizations from appropriate mathematical rules. 
The examples above suggest that students need repealed instruction 
on relationships between the elements of a function. 



Summary of Results and Instructional Implications 

Only a tiny percentage, of students completed the problem correctly. 
More than 20 percent of the students were unable to make any 
connection between the verbal statement and a figure, leaving the 
paper entirely blank. Forty-three percent of the students in the sample 
gave a figure that showed some misconception about the directions. 

Of the 37 percent who drew the figure correctly, only about 20 percent 
(or 7 percent of the entire student sample) were successful in comput- 
ing the sequence of areas for the five interior squares. 

Of the students who found the correct sequence of areas, or a plausible 
sequence that was partly correct, about 10 percent stated an appropri- 
ate rule for their data. Approximately 3 percent of this sample were 
able to conclude that the area of each successive square was half that 
of the preceding square. About half of these students were able to 
write either a general rule or a recursion formula for the sequence. 
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. . . problem E summary of results 



Students' descriptions and diagrams of their work revealed a series of 
ways they went astray: only 1.5 percent successfully completed the 
entire problem. Major implications for instruction are fourfold. First 
students need experience translating verbal instructions into geomet- 
ric figures, experimenting until the two correspond. Second, they need 
practice making charts of the mathematical patterns they discover so 
that they can generalize to a mathematical rule. Third, they need to 
highlight the relationships between elements of functions, in this case, 
between the sequence number of the interior square and its area. 
Finally, students should go by the information given in the problem 
and not be misled by the squares on the graph paper. The units of 
measurement specified in the problem are what is important. 



Relationships 
between elements of 
functions need to oe 
highlighted. 
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Part III 



Scoring Students' Responses to 
Open-ended Questions in Mathematics 

Part HI contains a discussion of the CAP advisory committee's reasons 
and procedures for dev oping the scoring rubrics used in the open- 
ended questions. As a help to persons interested in developing their 
own rubrics, suggested procedures are given. Scoring rubrics for each 
of the problems, A through E, and a generalized rubric also appear. 

Development of Scoring Rubrics 

Open-ended mathematics questions are intended to provide evidence 
of the student's: 

• Understanding of mathematics 

• Use of mathematical knowledge 

• Ability to communicate about mathematics 

Development of scoring rubrics should reflect these aspects. In 
addition, the forms of mathematical thinking required to solve a given 
problem should be considered. For example, solving an applied 
measurement question may require a strategy different from that used 
in attacking a question on probability and statistics. A scoring rubric 
should describe the strategies students can use to solve a problem as 
well as the expectations for students' understanding, use, and commu- 
nication of mathematical concepts. 

The CAP advisory committee decided to develop and use individual 
rubrics to score each of the questions rather than to have a single rubric 
j that would apply for all questions. This need emerged from the 
j concern that a single generalized rubric would mask the particular 
i mathematical outcomes that could be exemplified through a custom- 
! ized rubric. The following method was used to develop the rubrics for 
| problems A through E administered in 1987-88. 
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. . . development of scoring rubrics 



First, the committee members looked at each question (without look- 
ing at students' papers) and discussed desirable responses for each 
question. Next, a large sample of papers for each question was read 
holisttcally and classified in one of the six categories ranked from 1 to 
6, 1 being the lowest and 6 the highest rank. The committee members 
then described the characteristics of papers falling into each of the six 
categories. These descriptions were again discussed by committee 
members to clarify criteria for papers falling into each category. This 
process was refined during several committee meetings. 

The committee also develop ?d a generalized rubric that could be 
applied to all the questions, the purpose of which was to establish 
consistency across questions and over a span of years. The committee 
members strongly believe that the generalized rubric should not be 
used by itself for scoring; howe/er, this rubric can be a helpful guide 
to develop specific rubrics for open-ended questions. 

The committee members also discussed the scores (1 through 6) in 
relation to competency in mathematics. The following description 
shows that relationship: 

Competency Levels Rating/Score 
Demonstrated Competence 



Exemplary 
Competent 



6 
5 



Satisfactory 



Minor flaws 
Serious flaws 



4 

3 



Inadequate 



Begins, but not completed 
Unable to begin 



2 
1 



(No attempt) 
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. . . developing your own rubrics 



Procedure for Developing Your Own Rubrics 

You are welcome to use the open-ended items printed in this report or 
other items to develop your own rubrics. Here is a suggested proce- 
dure: 

1. Have your students work the open-ended problem. 

2. Have your faculty colleagues in mathematics do the same 
problem. 

3. Discuss the problem as a faculty group and try to sort the 
students' papers into six groups, with six being the highest 
rank and one the lowest. 

4. Discuss the characteristics of the responses and articulate a 
rubric for an exemplary rating (six) response. 

5. Articulate rubrics for the other categories. 

6. Take a second look at the students' papers and, based on 
your rubrics, regroup them as needed. 

1987-88 Individual Scoring Rubrics for Problems A Through E 

The following pages give scoring rubrics for problems A through E 
administered in 1987-88. A generalized rubric is given at the end of 
these rubrics, followed by ten marked illustrative papers. Although 
no rubric is provided for the five 1988-89 open-ended questions, ten 
marked illustrative papers are provided for that year. Teachers are 
encouraged to develop their own rubrics for these questions. Prelimi- 
nary rubrics for 1988-89 can be obtained from the CAP office on 
request The address is California Assessment Program, California 
State Department of Education, P.O. Box 944272, Sacramento, CA 
94244-2720; telephone (916) 322-2200. 
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. . . problem A scoring rubric 



r 



Scoring Rubric for Problem A 

A correct response to Problem A requires that the student be capable of giving 
directions to a peer for reproducing two geometric figures; one, a right triangle; the 
second, a nonstandard figure. Scorers look for coherent, unambiguous descriptions 
that make effective use of proper mathematical terminology. To obtain the highest 
score, students must communicate correct lengths and orientation. Coordinate geo- 
metry may be used; the students should then give the order in which points are joined. 



For 6 points: 



For 5 points : 



For 4 points : 



Demonstrated Competence 

The student, using mathematical ideas, effectively gives a coherent description 
that would result in the reproduction of a correct figure with respect to side 
length and orientation. If coordinates are used for Part b, the directions for 
connecting them must be unambiguous. The instructions can be interpreted 
easily. 

The student gives a coherent description, but there is some minor omission. 
Satisfactory Response 

The student gives a coherent description, but there is some major omission that 
would result in figures drawn with errors such as incorrect lengths or orienta- 
tion. 



For 3 points : 



For 2 points : 



Adequate descriptions using some mathematical terminology are given, but 
there are some misdirections, such as failure to describe diagonal segments or 
failure to direct the student receiving the description to connect parts of the 
diagram. 

Inadequate Response 

Inadequate descriptions for drawing the figures are given. While the student 
uses some mathematical terminology, there are serious omissions or misdirec- 
tions. 



For 1 point : 



The descriptions of each figure show misuse or minimal use of mathematical 
ideas. 



Off Track : 
Remark: 



The student leaves a blank page or writes: "I don't know." 

Location of the figures on the paper (top, bottom, or middle) was considered to 
be a minor issue. 
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. . . problem B scoring rubric 



Scoring Rubric for Problem B 

The student must detect errors, or lack thereof, in three geometric figures: a triangle 
whose angle measures do not add up to 180, a trapezoid, and a circle with a chord 
longer than twice the radius (i.e., longer than the diameter). To obtain the highest score, 
students must specifically state that there is no error in the second figure, and they must 
use good reasoning based on geometric principles in identifying the errors in figures 
Tandm. 



Demons 



Com; 



Fbr 6 points ; 



For 5 points: 



Fbr 4 points; 



For 3 points : 



Figures I and in are found incorrect and good explanations are given, with 
evidence of high-level thinking in the application of geometric principles. A 
statement for Figure II indicates that the figure is valid. 

Both figures I and HI are marked as incorrect, and good explanations are given. 
No findings are given fbr Figure II. 

Satisfacto ry Response 

Either Figure I or Figure III is marked as incorrect, but the student uses a level 
of thinking in the explanation that is higher than that in an answer awarded 3 
points. 

Either Figure I or Figure in is marked as incorrect, and an explanation invol- 
ving geometric principles is given (e.g., the sum of the measures of the angles 
in a triangle must be 180 degrees; a chord of a circle cannot be longer than the 
diameter). 



For 2 points : 
For 1 point : 

Off Track : 



I nadequate Response 
Only one of the three findings is correct. 

The response indicates some thinking relevant to the task, but none of the 
student's findings is correct. 

No relevant response is given, or the page is left blank. 



J 
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. . . problem C scoring rubric 



r 



Scorb ig Rubric for Problem C 

Students are given an example of a logic problem that involves college acceptance. The 
student must give a clear and mathematically correct explanation of the faulty 
reasoning involving the assumption of nonoverlapping sets in the problem For the 
highest score, responses must be complete, contain examples and /or counterexamples 
of overlapping sets, or have elegantly expressed mathematics. A diagram is expected. 



For 6 points: 



For 5 points: 



For 4 pointy 
For 3 ppjnts; 



For 2 points : 



For 1 point : 



Demonstrated G 



Off Track: 



The response is exemplary. It goes beyond the criteria for 5 points. For 
example, the response may include: 

• Examples) and/or counterexamples) 

• Mathematics expressed elegantly 

• An explanation that is complete 

The response is correct and the explanation is clear. It may be expressed in 
words, with a diagram, or both. 

Satisfactory Response 

The response is generally correct, but the explanation lacks clarity. 

The response indicates a partial solution (e.g., the same 50 percent are accepted 
by both colleges); or the response indicates that the student wayunderstand the 
solution but the explanation is incoherent. 

Inadequate Response 

The response is incorrect, but it shows evidence of mathematical reasoning. A 
mathematical explanation is developed. However, the explanation does not 
address the crux of the problem or the essence of the solution. The paper may 
include a mathematical misconception. 

The response is incorrect It is not a sensible mathematical solution of the 
problem. The justification may use irrelevant arguments, such as: 

• Whether a student is qualified for college 

• Where a student attends college 

• Whether a student desires to attend college 

• Whether a student has applied to college 

The student leaves a blank page or writes: "I don't know." 
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. . . problem D scoring rubric 



r 



Scoring Rubric for Problem D 

Caution: The scorer must recognize that different parts of a student's response may 
be accorded different scores. In these cases the scorer must assign a score reflecting the 
average quality of the total response. 

Students are asked to identify and describe the most similar and the most dissimilar 
pairs from a set of three problem situations. They must identify the mathematical 
criteria— for example, functions, givens, or goals — on which their judgments are based 
and show how their choices reflect these criteria. For the highest scores, responses 
showing students' criteria for classifying problems as most similar or most dissimilar 
must reflect high-level mathematical thinking. The student must observe and give 
examples of how different criteria would produce different answers. In addition, the 
student must show why the problem not selected as most similar or most dissimilar 
fails to meet the criteria for classification. 



For 6 points: 



For 5 points : 



For 4 points : 



Demonstrated Competence 

The student observes that the answer to the question will vary according to 
different mathematical dimensions. He or she gives examples of how the 
answer might vary. The dimensions used might include functions, givens, and 
goals. If the student chooses to argue that one pair is more similar to or different 
from another according to a set of criteria, he or she supports the argument by 
showing why the nonselected pair is inferior according to the dimensions 
chosen. 

The student identifies the dimensions used to establish the degree of similarity 
or difference, referring to these dimensions in the examples. Some of the di- 
mensions will .epresent higher-level mathematical thinking. To receive 5 
points, the student must support the argument by showing why the nonse- 
lected pair is inferior according to the dimensions chosen. 

Satisfactory Response 

The student identifies the dimensions used to establish the degree of similarity 
or difference, referring to the example to illustrate the dimensions he or she 
selects. The dimensions may not represent as high a level of thinking as that of 
students who receive 5 points. The student who recei ves4 points may not refer 
to as many dimensions as those who receive 5 points. The student will usually 
fail to support his or her argument by showing why the nonselected pair is 
inferior according to the dimensions chosen. 
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. . . problem D scoring rubric 



For 3 points : The student uses some of the components that earn 4 points but foils to give 

evidence of higher-level mathematical thinking. Although the student gener- 
ally includes more than one dimension to support the argument, the dimen- 
sions still tend to be superficial. The argument may contain minor inaccurate 
statements. 



lna^gqu^tgR^sppngg 

For 2 points : The student does not identify more than one mathematical dimension of 

similarity or dissimilarity. This dimension tends to be superficial. The 
argument may contain inaccurate statements. 

For 1 point: The student attempts to answer the questions but makes major errors. At best, 

one trivial piece of evidence, such as the appearance of the same constants in 
two of the problems, is given to prove similarity. 

Off Trapk : The student leaves a blank page or is off topic; no attempt is made to answer the 

questions. 
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. . . problem E scoring rubric 



Scoring Rubric for Problem E 

Students must follow instructions to draw correctly a sequence of interior squares 
based on midpoints of sides of previously drawn squares. They must then calculate 
areas of interior squares and finally generalize to write a rule for the area of the «th 
interior square. To receive the highest score, students must complete all three parts of 
the problem correctly. The rule may be a formula equivalent to 1/2* 3 or it may be 
recursive, in which case the area of the initial square must be stated. 



For 6 points: 



ForSppjnts: 



For 4 points : 



For 3 points : 



For 2 points : 



For 1 point: 



Off Track : 



Demonstrated Competence 

Everything is correct, including the picture (five interior squares), the scale, the 
sequence of areas, and the rule. The rule may be a formula (equivalent to 
1/2* 2 ) or recursive, equivalent to /4, = 2, and A 9 ^ = AJ2. Note: The rule 
"1/2 previous area" without the initial area is not adequate. 

There is a correct drawing and a correct sequence of areas (e.g., 2, 1, 1 /2, 1 /4, 
1/8) but not a rule. 

Or, there is a correct drawing a correct sequence, and a correct rule except for 
scale. 

Or, there is a modified drawing (not trivial), a consistent sequence to scale, and 
a consistent rule. 

Satisfactory Response 

There is a correct drawing for Part a; for Part b, a correct sequence of areas 
except for the scale derived from mislabeling the original square (e.g., 32, 16, 8, 
4, 2); Part c is not attempted. 

Or, the problem is modified; but it is nomrivial, and a consistent sequence of 
areas and a rule (Part c) are given. The scale may still be incorrect 

A correct drawing shows five interior squares; no other correct information is 
presented. 

Or, the problem is altered by a modification of the drawing, producing a trivial 
problem; a correct solution for Part b is given in accord with the modification. 

^equate Response 

The drawing shows the midpoints of the original square or of subsequent 
squares, but midpoints are not connected in order. There is no other correct 
information presented. 

Some attempt is made at a solution, but no indication is given of an under- 
standing of midpoints. 

The student leaves a blank page or writes: 1 don't know." 



Remark: Misinformation in one part does not reduce points earned in other parts. 
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. . . generalized rubric 



Generalized Rubric 



Demonstrated Competence 
Exemplary Response . . . Rating * 6 

Gives a complete response wi*h a dear, coherent unambiguous, and elegant explanation; 
includes a dear and simplified diagram; communicates effectively to the identified audience; 
shows understanding of the open-ended problem's mathematical ideas and processes; identi- 
fies all the important elements of the problem; may indude examples and counterexamples; 
presents strong supporting arguments. 

Competent Response . . . Rating ■ 5 

Gives a fairly complete response with reasonably dear explanations; may include an appropri- 
ate diagram; communicates effectively to the identified audience; shows understanding of the 
problem's mathematical ideas and processes; identifies the most important elements of the 
problems; presents solid supporting arguments. 

Satisfactory Response 

Minor Flaws Bnt Satisfactory . . , Rating « 4 

Completes the problem satisfactorily, but the explanation may be muddled; argumentation may 
be incomplete; diagram may be inappropriate or unclear; understands the underlying mathe- 
matical ideas ; uses mathematical ideas effectively. 

Serious Flaws But Nearly Satisfactory . . . Rating m 3 

Begins the problem appropriately but may fail to complete or may omit significant parts of the 
problem; may fail to show full understanding of mathematical ideas and processes; may make 
major computational errors; may misuse or fail to use mathematical terms; response may reflect 
an inappropriate strategy for solving the problem. 

Inadequate Response 

Begins. But Fails to Complete Problem . . . Rating ■ 2 

Explanation is not understandable; diagram may be unclear; shows no understanding of the 
problem situation; may make major computational errors. 

Unable to Begin Effectively . . . Rating ■ 1 

Words do not reflect the problem; drawings misrepresent the problem situation; copies parts of 
the problem but without attempting a solution; fails to indicate which information is appropri- 
ate to problem. 

No Attempt . . . Rating ■ 0 
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Part IV 



Additional Responses and Problems 

Part IV contains 20 scored students' responses: two each for the ten problems given in 1937 and 
1988. Scores appear at the top of each page. The report concludes with a set of nine open-ended 
problems that have not been been tested. Teachers may wish to try some of these problems in 
class and develop scoring rubrics for them. 



Sample Scored 1987 Responses 



r 



* 



California M r Assessment Program 



scores 



© 



Survey of Academic Skiffs 



OPEN-ENDED MATHEMATICS QUESTION(S) 



Imagine you are talking to a student in your class on the telephone and want the student to 
draw some figures. The other student cannot see the figures, Write a set of directions so 
that the other student can draw the figures exactly as shown below. 



•) 




b) 



/ 



\)a££* polri't arid ojf^w €\ 

%) f-W r» i£-.t»V* 2» u*\l\s. <&*A\ <f\>\zl I {i/w/'f 

ves4- , >JK.1s w'-J \ (ia<2^ 
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. . . 1987 problem A 



California **r Assessment Program 



scores 



© 



Survey of Academic Skills 



OPEN-ENDED MATHEMATICS QUESTION(S) 



Name. 



Instructions: Use this sheet to answer the questions. Show as much of your work as possible. (In 
some cases, there may be more than one solution.) Use the reverse side of this sheet if needed. 



Imag i ne you are ta lk^ to a ttubemln your class ] 
fln^itiinf flgurqK The other ttiftent < 

#4u.e- 4flw4 Aakny ^#a ^J^e fc# j 




Bleo hone a nd w ant the studen t to 
Write j set of directions so 




-L&$™* _*<*f^<- f*f* f ~ ^f**^ 





jV<fcL> 0tfA*J <* 1f*L douyy ? wd3Z* 
&4 Uft *\dt. 3 J 
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California M f Assessment Program 



score = 



Survey of Academic Skills 



OPEN-ENDED MATHEMATICS QUESTION(S) 



B 



Name. 



instructions: Use this sheet to answer the questions. Show as much of your work as possible, (in 
some cases, there may be more than one solution.) Use the reverse side of this sheet if needed. 



Look at these plane figures, some of whteh are not drawn to scale, investigate what might 
be wrong (If anything) with the given Information. Briefly write your findings and Justify 
your Ideas on the basis of geometric principles. 




idsji^O^^^^o^ix uj^ to 





12 



B 



m. 
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California *f Assessment Program 



scores 



e 



Survey of Academic Skills 



OPEN-ENDED MATHEMATICS QUESTION(S) 



B 



Name. 



Instructions: Use this sheet to answer the questions. Show as much of your work as possible, (in 
some cases, there may be more than one solution.) Use the reverse side of this sheet if needed. 



Look at these plane figures, some of which are not drawn to scale. Investigate what might 
be wrong (if anything) with the given Information. Brfrfiy write your findings and Justify 
your ideas on the basis of geometric principles. 




The stern o< 4 he 
three oriqics should 
add up /QO° 
instead of not 



N. 




c<c€p~f fhct+ -rhe GoutC 
is r>of dvaton to J 




No-r-h i n 
la; i 
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... 1987 problem C 





IWI e/^/\rA » Survey of Academic Skills 

Cal»omla y P Assessment Program 5WUr» - ^jj 

OPEN-ENDED MATHEMATICS QUESTIONS) C 




Name 




instructions: Use this sheet to answer the questions. Show as much of your work as possible, (in 
some cases, there may be more than one solution.) Use the reverse side of this sheet if needed. 


James knows that half of the students from his school are accepted at the public university 
nearby. Alto, half are accepted at the local private college, James thinks that tnts adds up 
to 100%, so he will surely be accepted at one or the other Institution. Explain why James 
may be wrong, If possible, use a diagram in your explanation. 

priua^e Co|\eoe Pull ic Ov\T vers I 4y 

&0 SO ' 
\\ow ever 3 

^>owo v^i r ,y i-i-^dle^-l j were ^Cep-}e<6 t-o ko-fl, 
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California w f Assessment Program 



scores 



© 



Survey of Academic Skills 



OPEN-ENDED MATHEMATICS QUESTION(S) 



Name- 



Instructions: Use this sheet to answer the Questions. Show as much of your work as possible. (In 
some cases, there may be more than one solution.) Use the reverse side of this sheet if needed. 



James knows that half of the students from his school are accepted at the public university 
nearby. Also, half are accepted at the local private college. James thinks that this adds up 
to 100%, so he will surely be accepted at one or the other Institution. Explain why James 
may be wrong. If possible, use a diagram In your explanation. 

be. 

m/U| c^£L±» cu.- *^&J2S2( ^d^^^SL pA^AfcsJdL 

..2d ^pL*^u2> nu^tU >\^k bsL- j*Kid2*AdUjc(. ca~* c^uy 
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...1987 problem D 



/ I ^ 

IWI e^orfii — flrV Sunny of Academic Skiffs 

California °P Assessment Program ouwit? — 

OPEN-ENDED MATHEMATICS QUESTION(S) D 



Name. 



Instructions: Use this sheet to answer the questions. Show as much of your work as possible. (In 
some cases, there may be more than one solution.) Use the reverse side of this sheet if needed. 



Consider the following problems. 



A. Maria has a job after school. Last week she worked 2 hours and earned $10,60. 
How much did she earn per hour? 

B. This week Marta worked 2 hours and earned $10.60 per hour. 
How much did she earn this week? 

C. Maria worked two Jobs. She earned $&26 on the first and $10.60 on the eeconU. 
How much did she earn altogether? 

1 . Whtah two problems are most similar and why? 

A £ S 



exre. &Kt ^o)q -ftr Uswr^j -JAwve v\y^\loCri 

A. fO, ■'(> ± A 

2. Which two problems are most dissimilar and why? 

sic 



]iZ ;$ C^e 7 eh 

\B is $)OSO per koor 

LA }S f/affi per vJ**i 
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California *r Assessment Program 



score ■ 



o 



OPEN-ENDED MATHEMATICS QUESTION(S) 



Survey of Academic Sfc///s 

D 



Name. 



Instructions: Use this sheet to answer the questions. Show as much of your work as possible ''r. 
some cases, there may be more than one solution.) Use the reverse side of this sheet if needed. 



Consider the following problems. 

A. Maria has a Job after school. Last week she worked 2 hours and earned $10.50. 





How much did she earn per hour? 

Bw This week Maria worked 2 hours and earned $10*50 per hour. 
How much did she earn this week? >L/i, , 

C. Maria worked two Jobs. She earned $&2S on the first and $10.50 on the second. 
How much did she earn altogether? £7 

1. Which two problems are most similar and why? 





'£( '•00 



io-5o itEotto e&uaf fhi k>toP 




2. Which two problems are most dissimilar and why? 




i &.. you mid -to. 
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California M |' Assessment Program 
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© 



Survey of Academic Skids 



OPEN-ENDED MATHEMATICS QUESTION(S) 



Name. 



Instructions: Use this sheet to answer the questions. Show as much of your work as possible. (In 
some cases, there may be more than one solution.) Use the reverse side of this sheet if needed. 



The square shown below has skies of length 2 unite. Connect the mtdpofrtts of the sides of 
the square, In order, to form an Interior square. Repeat the same process to make squares 
within 



a) Draw the first five 



UK-, I 




b) Write the sequence of numoers that represent the areas of the first five Interior squares. 



e) What rule can be used to find the area of the n* interior square? 



or 



4u ^ 
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© 



Survey of Academic Skills 



OPEN-ENDED MATHEMATICS QUESTION(S) 



Name. 



Instructions; Use this sheet to answer the questions. Show as much of your work as possible. (In 
some cases, there may be more than one solution.) Use the reverse side of this sheet if needed. 



The square shown below has sides of length 2 units. Connect the midpoints of the sides of 
the square, hi order, to form an Interior square. Repeat the same process to make squares 
within squares. 

a) Draw the first five Interior squares. 




b) Write the sequence of numbers that represent the areas of the first five Interior squares. 




A* 



a. 



b^ c % 



c) What rule can be used to find the area of the n* Interior square? 



63 



e 

ERIC 



. . . 1988 problem A 



Sample Scored 1988 Responses 
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California I Assessment 
Program 
1968-89 



score = 0 



survey of Academic Skills 




OPEN- 



MATHEMATICS QUESTION(S) 



Name 
School 



Sox 

District. 



fifmifft Date of Birth UlSzSL 



jM*uctlon»; Use this sheet to answer the questions. Show as much of your work as possible. (In some cases, 
there may be mors than one solution.) Use the reverse site of this sheet if needed 



The origin, 0, and point A on this graph 
represent opposite vertices of a rectangle 
whose area is 24 square inches. 



a) List one set of possible coordinates of 
point A 

b) Keep one vertex at the origin and the 
opposite vertex in the first quadrant 
Mark and label the coordinates of at 
least two more points that could be 
opposite vertices of rectangles of 




eppwiw von tees 01 rectangles of / \ - 



4$ 



. ■ ;V 




c) Hew many other points in this quadrant would give you rectangles with an 
area of 24 square inches if 0 is vertex and the points are opposite 
vertices of these rectangles? Explain your reasoning. 
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. . . 1988 problem A 
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California I Assessment 
Program 
1988-69 



score = 0 



Survey of Academic Skills 



OPEN-ENDED MATHEMATICS QUESTION(S) 



Sex — 

District. 



Date of Birth 



Name 

School 

I n str uction* : Use this sheet to answer the questions. Show as much of your work as possible. (In some cases, 
there may be more than one solution.) Use the reverse side of this sheet if needed 



The origin, 0, and point A on this graph 
represent opposite vertices of a rectangle 
whose area is 24 square inches. 

a) List one set of possible coordinates of 
pom, A 

b) Keep me vertex at the origin and the 
opposite vertex in the first quadrant 
Mark ami label the coordinates of at 
least two more points that could be 
opposite vertices of rectangles of 
area 24 square inches. Explain 
why you chose these coordinates. 




^k* U m*A 4« WjU Jum miltti . %m $ X 4 




c) How many other points In this quadrant would give you rectangles with an 
area of 24 square inches if 0 is one vertex and the points are opposite 
vertices of these rectangles? Explain your reasoning, 



For Teacher Use Only 




...1988 problem B 



& 

California I Assessment SCOTS s C% n 

* vw,c w Survey of Academic Skins 

198B-89 OPEN-ENDED MATHEMATICS <XESTTON(S) 



Name Sex £ Date of Birth SLil2l 

School — . District 



Instructions: Use this sheet to answer the questions. Show as much of your work as possible. {In some caws, 
there may be more than one solution.) Use the reverse side of this sheet if needed. 



You are a clerk in a garden shop. A customer comes to you for advice about his garden. 

The customer has had a rectangular shaped vegetable garden for several years. The 
length of the fence around it was 90 feet. He found, by experience, that he uses a 
1 00-pound bag of fertilizer on the garden each year. 

This spring, the customer tore down the old fence and threw it away. He decided to enlarge 
the size of his garden and make another rectangular garden with a fence of length 160 
feet He was not sure how much fertilizer he should buy. 

You, the clerk, are aware that the amount of fertilizer needed will depend on the size of 
the original and the new garden. Explain to the customer how he can find the number of 
5, bags of fertilizer needed for his new garden. Give some examples of possible dimensions 
of last year's and this years garden in your explanation You may want to use diagrams to 
help you explain ^ , , \ i , * 

?>•'. S,r } i 4!^ yo*r of,^*.] j »tJfr\ hel* i »' 



'< 
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.1988 problem B 



California I Assessment 
Program 
1888-89 



score = © 



B 



Survey of Academic Skills 



OPEN-! 



MATHEMATICS OUESnON(S) 



Name 
School 



Sex MALZ 
District _____ 



Date of Birth 2 3tftlf h?? 



Instructions; Use this sheet to answer the questions. Show as much of your work as possible, (in some cases, 
there may be more thai one solution.) Use the reverse side of this sheet if needed. 



You are a clerk in a garden shop. A customer comes to you for advice about his garden. 

The customer has had a rectangular shaped vegetable garden for several years. The 
length of the fence around it was 90 feet He found, by experience, that he uses a 
1 00-pound bag of fertilizer on the garden each year. 

This spring, the customer tore down the old fence and threw it away. He decided to enlarge 
the sire of his garden and make another rectangular garden with a fence of length 180 
feet. He was not sura how much fertilizer he should buy. 

You, the clerk, are aware that the amount of fertilizer needed will depend on the size of 
the original and the new garden. Explain to the customer how he can find the number of 
bags of fertilizer needed for his new garden. Give some examples of possible dimensions 
of last year's and this year's garden in your explanation. You may want to use diagrams to 
help you explain, 
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$6 
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. . . 1988 problem C 
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California! Assessment 
Program 

11 



SCOrO = Survey of Academic Skills 

OPEN-ENDED MATHEMATICS QUESTION(S) 



Name 
School 



JL 



Sex 

District. 



~ gate of Birth S| 2 Tj7j 



Instructions: Use this sheet to answer the questions. Show as much of your work as possible. (In some cases 
there may be more than one solution.) Use the reverse side of this sheet if needed. 



You have a bag of 30 identical wooden cubes. 



a) If you spread the cubes out on a table, how many of the cubes would you need to 
completely cover the largest possible square surface on the table? Draw a diagram. 



£5 




b) what is the largest 



< 



b 


Ijlj- 


4— i' & 2-& 


Lit-u 


HI 



e< :<? 



this is the largest possible cube 



•We cube you can make from the 30 cubes? Explain why 



c) How would you determine the largest cube that could be made from N identical 
small cubes? / , , , \3 > i 
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California I Assessment 
Program 

I WW W9 



score = O 

Survey of Academic Skills 

OPEN-B€>ED MATHEMATICS OUESTION(S) 



Name 
School 



Sax 
District 



Inttructic^ts: Use this sheet to answer the questions. Show as much of your work as possible. (In some cases, 
there may be more than one solution.) Use the reverse side of this sheet if needed. 



You have a bag of 30 identical wooden cubes. 

a) if you spread the cubes out on a table, how many of the cubes would you need to 
completely cover the largest possible jguai£L§urface on the table? Draw a diagram. 




b) What is the largest possible cute you can make from the 30 cubes? Explain why 

this is the largest possible cube. "* 



c) How would you determine the largest cube that could be made from N identical 
small cubes? 

jkJoocfcs o^A )<*- &&&& VV «^rcA 



tortus 
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California I Assessment 
Program 
1968-89 



score = © Survey of Academic Skills 

OPEN-ENDED MATHEMATICS QUESTIONS) 



Name 
School 



Sex -L 

District . 



Date of Birth If 31 / ^1 



tn * tructions: Use this sheet to answer the questions. Show as much of your work as possible. (In some cases 
there may be more than one solution.) Use the reverse side of this sheet if needed. 



Writing Situation 

You and a good friend Sheila were shopping in a grocery store for food and beverages for 
a picnic. When you were buying soda, you noticed that you could buy it in quart {32 oz.) 
bottles or in six-packs of 12 oz. bottles. The six-pack cost $1 .49, and the quart bottle cost 
$0,73. Sheila suggested buying two quart bottles, because it would be cheaper. Being 
thrifty, you took out your pocket calculator and in a few seconds said you should buy the 
six-pack because you get more soda per dollar. Sheila was impressed and asked how vou 
knew that 

Instructions for Writing 

Tell Sheila how you knew that the six-pack of soda was a better value than two quart 
bottles. Explain your method so that Sheila will understand why your calculations were 
valid and how she can make the same kind of calculation whenever she is in a similar 
situation. 



\.W ft , 4*. 32 *4 



To I 



1 
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California I Assessment 
Program 
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SCOF© s Survey of Academic Skills 

OPEN-BOED MATHEMATICS QUESTION(S) 



Name 
School 



Sex 

District. 



-r — , Date of Birth 3 / 2! 7*7* 



instructions: Use this sheet to answer the questions. Show as much of your work as possible, {in some cases, 
there may be more than one solution.) Use the reverse side of this sheet if needed. 




wminfl situation 

You and a good friend Sheila were shopping in a grocery store for food and beverages 
a picnic When you were buying soda, you noticed that you could buy it in quart (32 
bottles or in six-packs of 12 oz. bottles* The six-pack cost $1.49, and the quart bottle cost 
$0.73. Sheila suggested buying two quart bottles, because it would be cheaper. Being 
thrifty, you took out your pocket calculator and in a few seconds said you should buy the 
six-pack because you get more soda per dollar. Sheila was impressed and asked how yoJ 
knew that 

instructions tot writtnp 



fZ 



Tell Sheila how you knew that the six-pack of soda was a better value than two quart 
bottles* Explain your method so that Sheila wilt understand why your calculations were 
valid and how she can make the same kind of calculation whenever she is in a similar 
situation. 



3. 



3* 



3l- 



7 



5 



""Bridle c£ ounces kM pvice *J 
Qcaxvc 6vJc wnt po\ duu\<jl . fa * ]>0JX~ 
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California ■ Assessment 
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score = 0 

Survey of Academic Skills 

OPEN-ENDED MATHEMATICS OUESTtON(S) 



Name 
School 



Sex — 

District. 



Date of Birth 



Instructions: Use this sheet to answer the questions. Show as much of your work as possible. (In some cases, 
them may be more than one solution,) Use the reverse side of this sheet if needed. 



John has four place settings of dishes, with each place setting being a plate, a cup, and a 
saucer. He has a place setting in each of four colors: green, yellow, blue, and red. John 
wants to know the probability of a cup, saucer, and plate being the same color if he 
chooses the dishes randomly while setting the table, 

Explain to John how to determine the probability of a cup, saucer, and plate being the 
same color. Use a diagram or chart in your explanation. 







9 
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California! Assessment 
Program 
1988*80 



score = Q 



Survey of Academic Skills 



OPEN-ENDED MATHEMATICS QUESTIONS) 



Name 
School 



Sex — 

District. 



Date of Birth Til Hint 



Instructions: Use this sheet to answer the questions. Show as much of your work as possibie. (m some cases, 
there may be more than one solution.) Use the reverse side of this sheet if needed. 



John has four place settings of dishes, with each place setting being a plate, a cup, and a 
saucer. He has a place setting in each of four colors: green, yellow, blue, and red. John 
wants to know the probability of a cup, saucer, and plate being the same color if he 
chooses the dishes randomly while setting the table. 

Explain to John how to determine the probability of a cup, saucer, and plate being the 
same color. Use a diagram or chart in your explanation. 

*JJU* to choc** Afif**^ s 
Uue cUMtuu & choosy 

<Juf , S^xkv 0 saucer } X^^ 
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Additional Open-ended Problems 



r 



Problem 1. 



14 



8 




Henry wants to make a box from an 8 inch by 14 inch piece of cardboard. By cut- 
ting the same-sized square from each corner, he can fold up the sides to make a box, 
as shown. 

If he cuts out only squares with whole-number sides, what is the volume of each 
box he can make? 



If he >s not restricted to whole-number squares, is there any larger box he can make 
from the cardboard? Explain. 
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Problem 2. 



(a) Draw three rectangles of different lengths and widths, each with a perimeter of 
36 units. Determine the area of each of the three rectangles. 



(b) Determine the length and the width of the rectangle that would have the great- 
est area. Use a chart or graph to justify your answer. 



^ — - 
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Mona wishes to drive from Ambrose (A) to Zenia (Z). She wants to know how 
many trips she can make to Zenia, using a different route each time. With the help 
of the road map given, show how she can systematically determine these routes if 
she must always be traveling in a southerly direction. 
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Problem 4. 



Suppose that a running track is designed with two semicircular ends and two 
parallel straightaways of 100 yards or more, as shown below. 




If the perimeter of the track is to be exactly 440 yards, explain how you would 
decide how long the straightaways should be and what the resulting diameter of 
the semicircles would be. 
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Problem 5. 



Room 15 has 8 tables that measure 3 feet by 6 feet each. The tables are made so that 
they have to be fastened together in one of three ways: 



When all of the eight tables are fastened together, how could they be arranged to 
give maximum seating? Draw a sketch and explain why you think this arrange- 
ment gives the most seating. 
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Problem 6. 





Favorite 




Grade 


No. of brothers 


Name 


sport 


Age 


in school 


and sisters 


Jack 


Tennis 


16 


10 


2 


Sean 


Tennis 


18 


12 


1 


Pete 


Baseball 


17 


12 


3 


Maria 


Golf 


16 


11 


2 


Kate 


Tennis 


17 


12 


1 


Sara 


Baseball 


17 


11 


2 


Jos£ 


Football 


15 


10 


4 


Hushi 


Crew 


18 


12 


3 


Bob 











Which person in the group is unique? Why? 



When a new student, Bob, arrives at school and data are collected, it is discovered 
that information about him is closest to that for a typical student. Complete 'he 
chart by showing the data for Bob, and explain how you arrived at your choices. 
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Problem 7. 




John took the picture shown on the left (Figure D to the copy machine to make a 
copy. He didn't notice that someone had left the machine set for a reduction to 80 
percent of original size (setting; .80). He gave the original picture away before he 
realized that he had actually made a reduced copy (Figure II). 

(a) Write an explanation telling John what setting he would have to set on the 
copy machine to obtain from his reauced copy a picture with the original 
dimensions. 

(b) What setting would he have to set on the copy machine to obtain from his 
reduced copy an enlargement that was 20 percent greater than the size of the 
original picture? 
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Writing Situation 

Your "chool dub can sell either hot chocolate or cold cider at the concert but not 
both. The club buys both drinks for 50 cents per cup and sells them for $1.00 per 
cup. In warm weather clubs sell an average of 300 cups of hot chocolate or 400 cups 
of cold cider. In cold weather they sell an average of 700 cups of hot chocolate or 
600 cups of cider. 

Your club wants to make maximum profit, but the weather is unreliable. You don't 
know whether it will be warm or cold on the day of the concert. Your club has 
asked you for advice on whether to sell hot chocolate or cold cider. 



Instructions for Writing 

Tell your club which drink you think they should sell. Explain why your choice is 
the best one, considering the unreliability of the weather. You may want to use 
tables or diagrams to help explain your choice. 
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Problem 9. 

At a party a cake is cut as follows: 

Kim takes t of the cake; 
Bill takes g- of what remains of the cake; 
Connie takes r of what remains; 
Antonio takes j of what remains; 
Keiko takes \ °* what remains; 
Jamal takes the remainder. 

Draw a diagram of the cake: 



1. How large is Jamal's piece of cake compared with Kim's? Explain your answer. 
You might want to refer to your diagram in your explanation. 

Now assume there are n people at a party. The first person takes ]• of the 
cake. The next person takes ~- of what remains, then ~ of what remains, 
and so forth, until the next to the last person takes \ of what remains. 

2. How large is the last piece of cake compared with the size of the first piece? 

3. Consider how the relative size of the piece of cake changes with successive cuts 
of the cake. Write a general statement about this situation that explains the 
relationship between the sizes of the pieces if you divide the cake this way. 



J 
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Publications Available from the Department of Education 

Hits publication is one of over 650 that are available from the California State Department of Education. Some of the 
more recent publications or those most widely used are the following: 



ISBN T^te (Date of publication) Price 



0^01 14)271-5 Academic Honesty (1986) ~ $2.50 

0-8011-0722-9 Accounting Procedures for Student Organizations (1988) .„ 3.75 

0-801 1 -0272-3 Administration of Maintenance and Operations in California School Districts ( 1 986) 6.75 

0-8011-0216-2 BilmguaK^rosscultural Teacher Aides: A Resource Guide (1984) „ 330 

0-8011-0238-3 Boating the Right Way (1985) ~ 4.00 

0-801 1-0275-8 California Dropouts: A Status Report (1986) 250 

0-801 1-0783-0 California Private School Directory, 1988-89 (1988) 14.00 

0-801 1-0747-4 California Public School Directory (1 989) ~~ ~ ~~ 14.00 

0-8011-0748-2 California School Accounting Manual (1 988) ~ 8.00 

0-8011-0715-6 California Women; Activities Guide. K — 12 (1988) .350 

0-801 1-0488-2 Caught in the Middle: Educational Reform for Young Adolescents in California Public Schools (1987) 5.00 

0-8011-0760-1 Celebrating the National Reading Initiative (1989) ~ 6.75 

0-801 1-0241 -3 Computer Applications Pluming (1985) ~ ~ - 5.00 

0-8011-0797-0 Desktop Publishing Guidelines (1989) ! ~ 4.00 

0-801 1-0749-0 Educational Software Preview Guide, 1988-89 (1988) — 2.00 

0-801 1-0489-0 Effective Practices in Achieving Compensatory Education-Funded Schools U (1987) 5.00 

0-8011-0041-0 English-Language Arts Framework for California Public Schools (1987) 3.00 

0-8011-0731-8 English-Language Arts Model Curriculum Guide, K — 8 (1988) ~ 3.00 

0-801 1 -0786-5 E n ri c hm ent Opportunities Guide: A Resource for Teachers and Students in Mathematics 

and Science (1988) ~ ~ ~ 8.75 

0-801 1-0710-5 Family Life/Sex Education Guidelines (1987) ~ 4.00 

0-8011-0804-7 Foreign Language Framework for California Public Schools (1989) ..... „ 550 

0-801 1 -0751 -2 Fust Moves: Welcoming a Child to a New Caregiving Setting (videocassetxe ami guide) ( 1 988)* 65.00 

0-801 1-0289-8 Handbook for Physical Education (1986) ~ .... 450 

0-801 1-0249-9 Handbook fry Planning an Effective Foreign Language Program (1985) 350 

0-801 1-0320-7 Handbook for Planning an Effective Literature Program (1987) ~ 3.00 

0-8011-0179-4 Handbook for Planning an Effective Mathematics Program (1982) 2.00 

0-801 1-0290-1 Handbook for Wanning an Effective Writing Program (1986) 250 

0-801 1-0224-3 Handbook for Teaching Cantonese-Speaking Students (1984) _ 450 

0-801 i-0680-x Handbook for Teaa^g Japanese-Speaking Students (1987) „ ~ 450 

0-801 1 -0291 -* Handbook for Teaching Klipim^Speaking Students (1986) 450 

0-801 1-02W-9 Handbook for Teaching Portuguese-Speaking Students (1983) - ~ 450 

0-801 1 -0250-2 Handhx* cm California Education for Language Minority Parents— Chinese/English Edition (1985)f 3.25 

0-801 1-0737-7 Here They Come: Ready or Not— Report of the School Readiness Task Force (Summary) (1988) 2.00 

0-801 1-0734-2 Here They Come: Ready or Not— Report of the School Readiness Task Force (Full Report) (1988) 4.25 

0-801 1 -0735-0 Here They Come: Ready or Not — Appendixes to the FuL Report of the School Readiness 

Task Force (1988) ..... ~ .. 1650 

0-8011-0712-1 History-Social Science Framework for California Public Schools (1988) ... 6.00 

0-801 1-0782-2 Images: A Workbook for Enhancing Self-esteem and Promoting Career Preparation, Especially 

for Black Girls (1989) 6.00 

0-801 1 -0227-8 Individual Learning Programs for limited -English -Proficient Students (1984) 350 

0-801 1-0767-9 Infant ami Toddler Program Quality Review Instrument (1988) ~ 2.00 

0-801 1 -0750-4 Infant/Toddler Caregiving: An Annotated Guide to Media Training Materials ( 1 989) 8.75 

0-801 1-0466-1 Instructional Patterns: Curriculum for Parenthood Education (1985) 12.00 

0-801 1-0208-1 Manual of Firet-Aid Practices for School Bus Drivers (1983) 1 .75 

0-801 1-0209-x Martin Luther King, Jr., 1929—1968 (1983) 3.25 

0-801 1-0358-4 Mathematics Framework for California Public Schools (1 985) 3.00 

0-801 1-0664-8 Mathematics Model Curriculum Guide, K— 8 (1987) 2.75 

0-801 1-0725-3 Model Curriculum for Human Rights and Genocide (1988) 3.25 

0-801 1-0252-9 Model Curriculum Standards: Grades 9—12 (1985) 5.50 

0-801 1 -0762-8 Moral and Civic Education and Teaching About Religion (1988) 3.25 

0-801 1-0229-4 Nutrition Education— Choose Well, Be Well: A Curriculum Guide for Junior High School (1984) 8.00 

0-801 1-0228-6 Nutrition Education— Choose Well, Be Well: A Curriculum Guide for High School (1984) 8 00 

0-801 1-0182-4 Nutrition Education— Choose Well, Be Well; A Curriculum Guide for Preschool 

and Kindergarten (1982) 8.00 

0-801 1-0183-2 Nutrition Education— Choose Well, Be Well: A Curriculum Guide for the Primary Grades (1982) 8.00 

0-801 1-0184-0 Nutrition Education — Choose Well, Be Well: A Curriculum Guide for the Upper Elementary 

Grades(1982) ~ 8.00 

0-801 1 -0230-8 Nutrition Education— Choose Well, Be Well: A Resource Manual for Parent and Community 

Involvement in Nun- Education Programs ( 1 984) 4.50 



♦Videocassette also available in Chinese (Cm *) and Spanish at the same price. 

tThe following editions are also available, at the same price: Armenian/English, Cambodian/English, Hmong/Enghsh, Japanese/English, 
Korean/English, Laotian/English, Pilipino/English^Spanish/Engiish, and Vietnamese/English. 
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ISBN Title (Date of publication) Price 



0-801 1-01 85-9 Nutrition Education— Choose Well, Be Well: A Resomve Manual for Preschool, Kindergarten, and 

Hementary Teachers (1982) ~ S2.25 

0-801 1-01 86-7 Nutrition Education— Choose Well, Be Well: A Resource Manual for Secondary Teachers (1982) 225 

0-801 1 -0253-7 Nutrition Education— Choose Well, Be Well: Food Kioto Cards (with nutrient 

composition charts) (1985) - ....... 10.00 

0-801 1 -0254-5 Nutrition Education — Choose Well, Be Well: Teaching Materials for Preschool/Kindergarten 

Curriculum Guide On color) (1 985) 7.50 

0-801 1-0303-7 A Parent's Handbook on California Education (1986) 325 

0-801 1-0671-0 Practical Ideas for Teaching Writing <* a Process (1987) ~ 6.00 

0-801 1-0309-6 Program Guidelines for Hearing Impaired Individuals (1986) 6.00 

0-801 1 -0684-2 Program Guidelines far Visually Impaired Individuals (1987) M 6.00 

0-801 1-0815-2 A Question of Thinking: A First Look at Students' Performance on Open-ended Questions in 

Mathematics (1989) „ .6.00 

0-801 1-0213-8 Raising Expectations: Model Graduation Requirements (1983) 2.75 

0-8011-0311-8 Recommended Readings in Literature, K — 8 (1986) 2.25 

0-801 1-0745-8 Recommended Readings in Literature, K — 8, Annotated Edition (1988) ..............4.50 

0-8011-0753-9 Respectfully Yours: Magda Gerber's Approach to Professional Infant/Toddler Care 

(videocassette and guide) (1988)* 65.00 

0-8011-0214-6 School Attendance Improvement: A Blueprint for Action (1983) M 2.75 

0-8011-0189-1 Science Education for the 1980s (1982).... „ 2.50 

0-8011-0339-8 Science Framework for California Public Schools (1978) 3.00 

0-801 1 -0354- 1 Science Framework Addendum (1 984) 3.00 

0-801 1-0665-6 Science Model Curriculum Guide, K— 8 (1987) 32S 

0-801 1-0668-0 Science Safety Handbook for California High Schools (1987) 8.75 

0-801 1-0738-5 Secondary Textbook Review: English (1988) 9.25 

0-801 1-0677-x Secondajy Textbook Review: General Mathematics (1987) 630 

0-801 1-0781-4 Selected Financial and Related Data for California Public Schools (1928) 3.00 

0-801 1 -0752-0 Space to Grow: Creating a Child Care Environment for Infants and Toddlers (videocassette 

and guide) (1988)* „ 65.00 

0-801 1-0265-0 Standards for Scoliosis Screening in California Public Schools (1985) 230 

0-801 1-0486-6 Statement on Preparation in Natural Science Expected of Entering Freshmen (1986) 2 JO 

0-801 1-0318-5 Students' Rights and Responsibilities Handbook (1986) 2.75 

0-801 1-0234-0 Studies on Immersion Education: A Collection for U.S. Educators (1984) 5.00 

0-8011-0682-6 Suicide Prevention Program for California Public Schools (1987) 8.00 

0-801 1-0778-4 Survey of Academic Skills: Grade 12, Rationale and Content for English-Language Arts (1989) 230 

0-801 1 -0785-7 Survey of Academic Skills: Grade 8, Rationale and Content for Mathematics (1989) 230 

0-801 1-0808-x Survey of Academic Skills: Grade 12, Rationale and Content for Mathematics (1989) 230 

0-801 1-0739-3 Survey of Academic Skills, Grade 8: Rationale and Content for Science (1988) 230 

0-801 1-0192-1 Trash Monster Environmental Education Kit (for grade six) 23.00 

0-801 1-0236-7 University and College Opportunities Handbook (1984) 3.25 

0-801 1-0758-x Visions for Infant/Toddler Care: Guidelines for Professional Caregivers (1988) 530 

0-801 1 -0805-5 Visual and Performing Arts Framework for California Public Schools (1989) 6.00 

0-801 1-0237-5 Wet V Safe: Water and Boating Safety. Grades 4—6 (1983) 230 

0-801 1-0194-8 Wizard of Waste Environmental Education Kit (for grade three) 20.00 

0-801 1-0670-2 Work Experience Education Instructional Guide (1987) 1 230 

0-801 1-0814-4 Writing Achievement of California Eighth Graders: A First Look (1989) 5.00 

0-801 1-0464-5 Work Permit Handbook (1985) , 6.00 

0-801 1-0686-9 Year-round Education: Year-round Opportunities — A Study of Year-round Education 

in California (1987) 5.00 

0-801 1 -0270-7 Young and Old Together A Resource Directory of Intergenerational Resources (1986) 3.00 



Orders should be directed to: 

California State Department of Education 
P.O. Box 271 

Sacramento, CA 95802-0271 

Please include the International Standard Book Number (ISBN) for each title ordered. 

Remittance or purchase order must accompany order. Purchase orders without checks arc accepted only from govern- 
mental agencies. Sales tax should be added to all orders from California purchasers. 

A complete list of publications available from the Department, including apprenticeship instructional materials, may be 
obtained by writing to the address listed above or by calling (9 1 6) 445- 1 260. 



♦VideocdSseUe also available in Chinese (Cantonese) and Spanish at the same price. 
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